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ABSTRACT 

Biology classes of 15 teachers in three high schools 
were provided with a response sheet and requested to rate each 
ten-minute segment of lessons on each of three contrasts: too 
fast/too slow; interested/bored; and understand/don’t understand. 
They were also requested to make specific comments if they felt them 
necessary. It was found that students were able to give effective 
feedback to teachers, and that this feedback caused changes in 
teacher behavior. Analyses of the data were most meaningful when the 
changes within a single class were considered: changes in different 
directions in different classes obscured significant effects. Tabular 
and graphical data presentations are appended. (AL) 
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I. Introduction 



An inability to perceive and react to student, impressions 
(impressions such as: too fast, too slow, boredom, interest, 

understanding, etc.) hinders a teacher's ability to encourage 
student participation, maintain interest, and promote the 
inquiry strategies suggested in many of the new curricula. 

If teachers are to develop the ability to assess and utilize 
students' reactions to their classes, they must recognize pupils 
as integral parts of the instructional process. It is the 
purpose of this study to determine if the use of a pupil reaction 
device will cause teachers to become more aware of the attitudes 
of their pupils. This awareness will be reflected in the teacher's 
willingness to vary teaching behavior in order to promote more 
positive student feedback, 

II. Related Literature 

Grace E. Bird, in 1917, tried to describe an effective 
teacher by using feedback given by pupils. ] The children were 
as'^ed to write a description of their favorite teacher and to 
tell why the teacher was their favorite. What emerged was that 
students favored teachers who were responsive to their immed- 
iate needs. 

Roy C. Bryan studied the use of pupil ratings to improve 
teacher effectiveness in 193$. 2 The findings of the study, as 
reported in School Review , indicated teachers did react to 
student ratings given them at the beginning of the school year 
as evidenced by an increase in favorable scores given at the 
pfid of the year. Albert) observing thet teachers are usually 
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only rated by a principal or supervisor, developed his own 

rating scale to be used by students to determine their li'tes 

and dislikes in teacher behavior. 3 He found that student 

ratings did have an effect on teacher performance. Earl C. 

Bowman, reporting on pupil ratings of student teachers, used 
» 

ratings of student teachers prepared by pupils and compared 
them with ratings given the same student teachers by critic 
teachers.^ He found very little agreement between pupil and 
critic teacher -judgment as to the presence or absence of desir- 
able traits described by the Purdue Rating Scale of Teacher 
Efficiency. 

Remmers has pointed out that student evaluation has proven 

"reliable", "convenient", "useful", and "valid". ^ One of the 

more interesting melor rceneraliza tions drawn from research using 

the Purdue Scale is: Ratings of teachers by groups of 25 or 

more students are as reliable as any other means of rating. 

Smith reported on the Student Evaluation of Teachers Committee, 

where the "evaluator" as'*ed the pupils, as a group, pertinent 

sublective questions about the teacher.^ Smith found the pupils 

to be". . . competent judges of teaching s'cill."^ Hedges and 

MacDougoll urged that a monitoring device be implemented to 

tell the teacher what the student perceives to be going on in 

a classroom so that he may have immediate feedback of pupil 

7 

reaction, William D. Coats, using the Teachers Image Question- 
naire as prepared by Educator Feedback Cen f er at Western Mich- 
igan University, found the single most important item w^ich 

appeared to influence a teacher's rating by pupils was whether 

• A 

or not the students li'ced the teacher. 
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III. Statement of v he Problem 
This study attenuated to show that s teacher's pupils can 
be used to provide an effective and sensitive measure of teach- 
ing behavior in the for;m of timed hard copy feedback given the 
teacher at the end of each lesson. This study further attempts 
to describe the behavioral changes brought about by the pupils' 
hard copy feedback and the permanency of any change once the 
pupils' written feedback stops. 



IV. Procedure 



A population of If tenth grade biological science teachers 



were chosen from three separate high schools within Allegheny 
County during the 1971-72 school year. For each of the teachers 



and their pupils 
li ml nary data were gathered. 

Tupils 
1} age 

2) grade level 

(3) I.Q. - 

(b) socio-economic group 
( r ) school attending 



the following pre- 



Teachers 

(1) age 

(2) school where presently 
teaching 

school graduated from 
bS sex 

years experience teaching 
6) years experience teaching 
sublec t 

(7) number of credit hours in 
teaching field 



taking part in the study, 



Nine of the total l c teachers chosen for the first three 



months of the study were designated as Group I. Audio tapes 
of one class were made of each of the nine teachers. The 



class period chosen for each teacher was the only class for that 
teacher to be used throughout the three months. Two audio 
tapes per v;ee'c were te*cen of the experimental class. The time 
of the taping was chosen at random. (The reasons for taping 
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the classes in month (1) was to establish a base line of teach- 
ing behavior.) 

During the second month, in addition to continued audio 
taping, the coooereting teacher was asked to pass out to his 
pupils the rating sheet (see Appendix A) with these instruc- 
tions: "I want you to hfelp me to heln you learn biology. 

The sheet of paper you have on the desk in front of you is a 
means for you to tell me how I did today in frying to teach 
you biology. You will notice that the blocks from left to right 
are marked with comments and at the end of the blocks is a line 
with numbers ranging from 10 to ?0. What you are to do is, 
if at the end of ten minutes you think I was going too fast, 
you check "too fast". If I was boring you, check "boring". 

If it was interesting, check "interesting", etc. If you wish 
to soy something else, lust write it on the line provided. 

Then the next time you check will be at the end of the next 
ten minutes ( or 20 minutes after the lesson started), contin- 
uing in ten minute intervals all the way to the end of the lesson. 
If you forget or are too busy to check the clock, just skip over 
it end check when you have time, but do it in the appropriate 
time line. For example, it is now 12:00. If the next time 
you think to r*heck the sheet it is 12:20, check the 20 minute 
line, not the 12:10 line." The teacher continued to explain 
these directions until he was satisfied that he was understood. 

He then gave the planned lesson for the day and collected the 
sheets at the end of the period. If he found they did not follow 
instructions, he went over the instructions again the next day. 

The teacher was asked to use the rating sheets at least 
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twice per week during the first three weeks of the second 
month and only if he or hia students felt they needed them 
during the lest week. 

The teacher was asked to review the feedback written by 
his pupils on the sheets given him et the end of the experi- 
mental class to see how his students received his lesson. The 
cooperating teacher was also urged to respond to the sheets 
in such a manner as would emphasize behaviors and procedures 
that the pupils felt were good and to modify those behaviors 
or procedures that in the pupils' ludgment needed changed. 

During the third month, the nine teachers were asked not 
to use the pupil feedback form. Audio taping of the classes 
continued however, end three audio tapes were chosen for analy- 
sis . 

The following outline describes the schedule end the use 
of the response instrument. 

Ou tline of Procedure 

Month (1) 

1. Nine teachers chosen. (Group I) 

2. Background data taken. 

3. Audio tapes taken of each teacher during designated 
class period(s) . 

A, Three audio tapes chosen at random for each teacher. 
Month (2) 

1. Group I teachers explain rating device to pupils. 

2. Teachers utilize rating device. 

a. -- First, week - two times 

b. Second week - two times 
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c. Third week - two tines 

d. Fourth week - as the teacher feels necessary. 

3. Audio tapes taken of selected classes. 

4. Three audio tapes chosen at random for each teacher. 

Month (3) 

1. No rating device used by Group I teachers. 

2. Audio tapes taken and three chosen at random for each 
teacher. 

Month (^1) 

1. Six teachers chosen. (Group II) 

2. Background data taken. 

3. Audio tapes taken of each teacher during designated 
class period( s) . 

2|. Three audio tapes chosen at random for each teacher. 

Month ( c ) 

1. Group II teachers explain rating device to pupils. 

2. Teachers utilize rating device. 

a. First week - two times 

b. Second week - two times 

c. Third week - two times 

d. Fourth week - as the teacher feels necessary. 

3. Audio tapes taken of selected classes. 

A. Three audio- taoes chosen at random for each teacher. 

Month (6) 

1. No rating device used by Group II. 

2. Audio tapes taken and three chosen at random for each 
teacher. 
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V. Findings 

Preliminary analysis 

Three separate high schools participated in the study. 
School A is an urban, middle class high school with an enrol- 
lment of 3>200. High School B is an urban high school with 
an enrollment of approximately ^00 lower socio-economic students. 
High School C is in an upper-middle class suburb with an enrol- 
lment of over 2,000, 

Facilities at each school, provided for biology, ranged 
from a room with only a teachers' desh and student chairs, to 
elaborate laboratory set-ups with a green house and animal 
rooms. Only two of the l r groups were scheduled for biology 
for more than five periods per wee’t. These two had two extra 
laboratory periods per weex: for a total of seven. The average 

class size was 3? students with a range of 27 - 36. The mean 
I. a. of ell participating students was 10^4 with a range of 
class mean I.Q. 's of 93 - 121. Pupils ages averaged l c ,4 
years and 90 per cent of the students were in the tenth grade. 

Teachers participating in the study ranged in age from 
23 - *0 years old and had experience in teaching biology which 
ranged from 1 - l c years. The mean years experience was four 
years. There were 12 men and three women in the group. They 
graduated from ten different colleges and universities. 

Three tapes for each teacher for each month of the study 
were selected at random and coded using a modified Para'ch 
Interaction Analysis System. 9 Each selected tape was further 
coded using a Gallegher-Aschner Questioning Category System 
Analysis}^ The monogram codes of the Paraph were then placed 
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in a six-set matrix (Appendix 3) and the Der cent of lecture, 
per cent of discussion plus inquiry, and the per cent - of tran- 
sition* was calculated for each six-set for each teacher. 11 

* Da te Analysis 

The entire group of teachers were checked for significant 
change over the t'hree months with reSDect to the per cent of 
lecture discussion and transition, using ^he chi square test 

01 for *c independent samples. 12 The results showed: No signif- 

icant difference in the six-set analysis of the group teacher 
behavior over the three months period . 

Group teacher behavior was again inspected comparing 
months one to two, months one to three, and months two to three. 

02 The results indicated: No significant differences in the six- 

set analysis of the group teacher behavior was found between 
any pairs of months . This finding will be discussed below. 

Data for each teacher were then tested for significant 
differences in the six-set analysis of behavior over the entire 
three months, and between months one and two, one and three, 

03 and two and three. Significant differences in six-set analysis 
we re shovtn for most teachers . (See Appendix E Table 1) 

The first five sets of completed pupil reaction forms 
collected by ell l c teachers were totalled end treated for 
per cents (See Table 2, Appendix E and GraDhs 1 - Appendix 
C) . An interpretation of Graphs 1-4, Appendix C showed: 

04 Little difference in the per cent of reaction in any category 
over the entire time frame . It is then reasonable to assume 
that the pupils were not reacting in a "set pattern" regardless 

transition is a term to describe modes of performance which 
lead into or out of the maior modes; see Appendix B. 
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Of of teacher behavior. However, an increase in the total entries 
in the 20 - 30 minute time blocfr may be indicative of the time- 
honored tradition that nothing much happens in a class at the 
beginning and at the end. 

The data of four teachers were selected at random. Each. 
teecher H s pupil reaction sheets were compared from response 
set one through set five for significant change in the per cent 

06 of each category checked by the pupils. Significant differences 
were found in the responses from se t one through set five. 

It was reasoned that if the student-rating forms were hav- 
ing a positive effect on most of the teacher's behavior, then 
the ratio of all the students' positive to negative reactions 

07 would increase as time went on. It was found that the direction 
of change was positive for responses made by the students . 

(See Graohs 1 - 3# Appendix D) 

Product-moment coefficients of correlation and regression 

iq 

analysis ~ treatments were used to test the significance of 
relationships between student responses and the six-set analysis 
of teacher behaviors for the total lessons coded during the 

08 treatment month. Only five per cent of the test values were 
found to be significant at the five per cent level . The lac^ 
of significance was found to be attributable to the smoothing 
of data when grouped for lessons averaging k2 minutes in length. 
It is quite logical that when considering the approximately 

30 students who respond to behavior in a classroom every ten 
minutes, the total behavioral responses cannot reliably define 
the environment. 

It was then decided to select one 10-minute time interval 
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from each lesson and test the relationship of the pupil reactions 
to the sir-set analysis of that interval. The lessons were 
chosen on .the basis that they would be the first lesson taught 
by the teacher, and which had a corresponding set of pupil- 
rating sheets. The 20 - 30 minute time interval was chosen 
because it had an overall high N of responses given by pupils. 
Product-moment coefficients of correlation and regression analy- 
ses were then used to test the significance of relationships 
between student responses and six-set analysis of teacher 
behaviors for 1^ of the teachers during the given 10 minute 
09 time frame. It was found that three of the nine tests showed 
significant correlations at the five per cent level and two at 
the ten per cent level . (See Table 3, Appendix E) . 

Analysis of Findings 

The ability of students to sensitively and effectively 
give hard copy feedback to teachers is pointed out by findings 
01 and 02, where it was shown there were no significant differ- 
ences between the three months of group teacher behavior. 

This can be expected if individual differences of teachers are 
considered by students ana their reactions are to their teacher 
only and their reactions change as the teacher behavior changes. 
Although teacher A may change from a more lecture oriented 
behavior to a more discussion oriented behavior in response 
to the students’ feedback, this change could be cancelled 
by teacher B’s ’’movement” in the opposite direction in response 
to his students. These changes of behavior by different teachers 
is unique and the effect is that grouped data- treatments be- 
come less meaningful. 
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There seemed to be no pattern for filling out the reaction 
forms (Findings 0*1 and O c ). The students indicated they were 
as bored the first ten minutes as they were during the last ten 
minutes. Of course it was equally probable for them to be bored 
in the intervening intervals. On the other hand, the number 
of students resDonding at any one time interval is highly de- 
pendent to how close the time is to the middle of the lesson. 

The ParaVh Analysis^ of the original tapes point out a pos- 
sible explanation to this finding. There was little livelihood 
of anything of import happening in the first ten and last ten 
minutes of a class period. Most of this time was spent in 
processing routine procedures, generally wasteful activity, 
or conversation on the part of students and teacher. 

If students were reacting to their teacher and reporting 
it accurately as they perceived it on the reaction form, then 
as the teacher behavior changed, so too should the reaction form 
responses change. Finding 06 points out that there were sig- 
nificant changes in the day to day rating of each individual 
teacher sampled. 

The overall change in reaction for ell pupils is illus- 
trated by finding 07. The changes of ratios in "favorable" 
reaction by the students are indicative of teacher change. 

The change in teaching behavior is further illustrated by 
(Table 1 Appendix C) finding 03. With the exception of teacher 
C, all teachers changed significantly over the three month period. 
The maior changes occured between the first end second months 
and first and third months. The lowest amount of change was 
between the second and third months, however, only four chi 
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square tests were found not to be significant below the .0? 
level. This seems to be due to the teachers changing to a lesser 
degree after the second month of the study. 

The general direction of change in overall behavior during 
the three months, although not significant, was toward more 
lecture. During the treatment month, however, the direction 
was non-determinant for the group. Some teachers moved toward 
giving more lecture while others moved toward more discussion 
end transition. One of the most interesting findings was 09 . 

A positive correlation exists between the amount of lecture end 
the percentage of students responding to "understand" on the 
rating sheet and a negative relationship to the amount of 
discussion and transition. This then could account for those 
teachers who maintained or increased their amount of lecture 
during and after the treatment month. Finding 09 also shows 
a negative correlation between the "good" response and the amount 
of lecture and a positive correlation between transition end 
"good" . 

It would seem, for these groups of teachers and students, 
the students feel that in order to "understand", lecturing is 
desirable 8nd the amount of discussion with their peers seems 
to decrease their willingness to chec!c the "understand" reaction 
snuere. On the other hand, teacher led discussion, described 
as transition, is considered "good" by the students. 

The reasoning behind this seeming paradox could be any 
or ell of the following: 

1. If © teacher leads a discussion or "causes" one, 
students seem to regard his performance as of more 
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note than their peers, 

2. It is a good topic, but need no f necessarily be under- 
s tood, 

3. If one checks "good" they may not find it necessary 
to check any other square, 

A lecture need not necessarily be "good" but it may 
be understood; 

There seems to be some discriminators operating for 
topic differences. 

VI. Conclusions 

There are two maior conclusions to be drawn from the 
findings in the previous section. First, students do give 
meaningful, timed, hard copy feedback responses to teachers' 
behavior. Second, that if this feedback is even minimally 
used, as it was in this study, it can be expected to cause 
teachers to change their behavior and for many maintain this 
behavior, as evidenced by both six-set analysis and student- 
rating analysis. These changes in behavior are not regarded 
as any improvement in performances, nor do they indicate any 
quality in teaching. 

It is felt that such rating devices, employed on a day- to 
day basis, or whatever time schedule can be organized, should 
be used by supervisors who wish to help their present teachers 
and by those individuals responsible for the training of future 
teachers . 

The data further indicates that, in order to look at any 
affects and any relationships between student feedback and 
teacher behavior, it would be more valuable to look at small 
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sections of time and to focus on those small areas which con- 
stitute a one teacher one class interaction. 



16 



Appendix A 

Sample Student Reaction Sheet 



Teacher__^ 

/ - 



Date 



Too Fast 




Interested 


’ 


Understand 




Good 


Too Slow 




Bored 




Don ' t 
Understand 







Too Fast 




Interested 




Understand 




Good 


Too Slow 




Bored 


■ 


Don't 

Understand 







Too Fast 




interested 




Understand 




Good 


Too Slow 




Bored 




Don' t 

Understand 







Too Fast 


► 


interested 




Understand 


. 


Good 


Too Slow 




Bored 




Don’t 

Understand 







Too Fast 




interested 


! 


Understand 


> 


Good 


Too Slow 




Bored 




" Don' t 
Understand 







Too Fast 




Interested 


• 


Understanc 




Good 










Don't 






Too Slow 




Bored 




Understand 














f?oo Fast 




Interested 




Understand 




Good 


jroo Slow | 


i 


Bored 




Don't 

Understand 







12:00 


Comment 


12:05 


Comment 


12:10 


C omment 


12:15 


Comment 


12:20 


Comment 


12:25 


Comment 


12:35 



Comment 
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Six Set Matrix 




Cumulative Six Set 



Lec- 

ture 


Transition 


Trans- 

ition 


Trans- 

ition 


Discussion 


Trans- 

ition 


Trans- 

ition 


Transition 


Trans- 

ition 



o 

ERIC 



±8 



Appendix C Graph 1 
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Contrast of the Per Cent of Total Student 
Responses to Too Fast or Too Slow for Each Time Interval of the Lessc 



.3C 

Per Cent 
of 

• Re ap on see 






"SOmin. 3"0min. 40min . ^Om 
Minutes into Lesson 



= Too Past 



Too Slow 
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Contrast 
to Interested 



Per Cent 
of 

Responses 



Appendix C Graph 2 

of the Per Cent of Total Student Responses 
or Bored for Each Time Interval of the Lesson 




= Interested 
= Bored 



Appendix C Graph 3 

Contrast of the Per Cent of Total Student Responses 
to Understand or Don't Understand for Each Time Interval of Lesson 



Per Cent 
of 

Responses 




= Don't Understand 



Appendiv c Graph b 
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' Per Cent of Total Student Responses 
to Good for Each Time Interval of the Lesson 



Per Cent 
of 

Responses 
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Overall Ratio of Positive Negative Student 
Reations for All Teachers During the Second Month of the Study 



Ratio 

Positive/ Negative 




= First time sheet used 
+ Second time sheet used 
- Third time sheet used 
= Fourth time sheet used 
= Fifth time sheet used 
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Appendix D Graph 2 



Overall Ratio of Interes ted /Bored Student 
Reactions for All Teachers During the Second Month of the Study 



2i 



Ra t.io 

Interested/Bored 3 




1 = First time used 

2 = Second time used 

3 = Third time used 

4 = Fourth time used 

5 = Fifth time used 






Appendix D Graph 3 
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Overall Ratio of Unde r stand /Don* t Understand 
Student Reactions for All Teachers During the Second Month of the Stu' 




3 = Third time sheet used 

4 .= Fourth time sheet used 

5 = Fifth time sheet used 






Appendix E Table 1 

Chi Square Values of each Teacher 
and their Accompanying Levels of Significance 
Comparing All Three Months 






Month 3 



Teacher 


AFT 

Months 

Chi 

Square 


Level 

of 

Signif 

cance 

All 

Months 


Month 
1 to 2 
Chi 

Square 


Level 

of 

Signif- 
icance 
Months 
1 to 2 


Months 
1 to 3 

Chi 

Square 


| Level 
of 

Signif- 
icance 
Months 
1 to 3 


Montns " 
2 to 3 
Chi 

Square 


Level 

of 

Signif- • 
icance 
Months 
2 to 3 


A 


l8.i| a 


.001 


47.56 


.001 


40.21 


.001 


19.9 


.001 


B 


' 78.38 




38.48 


‘ .01 ' 


42.69 


' .001 


i lcj.65 


.05 ‘ ‘ 


C 


4.33 


• -' v - / 


10.27 


.15 


69.31 


.001 


r 

16.81 


.015 


D 


55.33 


.001 


36.36 


.001 


19.13 


.001 


17.28 


.002 


E 


23.08 


.001 


12.57 


.02 


33.44 


.001 


6.04 


• -L ^ 


F 


25.87 


.001 


39.92 


.001 


7.73 


.10 


33.12 


.001 


G 


71.90 


.001 


5.97 


pc 


12.43 


.02 


9.48 


.05 


H 


24.09 


.001 


20.00 


.001 


.03 


.50 


18.31 


.001 


I 


99.52 


.001 


30.61 


.001 


29.20 


.001 


20.82 


.001 


J 


23.19 


.001 


4.15 


.50 


1 

5.48 ] 


2 C i 


5.82 


.25 


K 


13.36 


.01 


23.17 


.001 


20.88 


.001 


9.68 


.05 


L 


J 

12.56 


) 

.02 


36.98 


.001 


5.42 


.05 


4.82 


.10 


M 


19.12 


.001 


27.71 


.001 


7.72 


.10 


5.07 


.25 


N 


41.93 


.001 


19.44 


.001 


23.98 


.001 


26.88 


.001 


0 


12.02 


.02 


2.44 




6.81 


.001 


13.04 


.001 



a. To be read as 9.488 at . 0 level of significance for 2 degrees 
freedom. 

b. Exception to above to be read as 5.991 at .Of# level of sig- 
nificance for 2 degrees of freedom. 
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Appendix E Table 3 



Comparison 


r x y 


X 

t 


y 


Lee ture-Interes t 


- . 0328 


1 < 

| .*1961 

I 


l 

.2*19*1 


Discus sion-Intes t 


-.1891 


. 1*106 


.2*19*1 


Transition-Interest. 


-.2383 


.3897 


.2*19*1 


Lee ^ure-Unders tend 


+. 78 c 3 ® 


.*1961 


.2802 


Discussion-Understand 


j ~.*l 977 b 


.1*106 


.2802 


Trensi tion-Unders tend i 

i 


i -.6816® 

! 


. 3 C 97 


.2802 


Lecture-Good 


-.*! 93 *i b 


.*1961 


.1763 


Discussion-Good 


-.1178 


. 1*1 06 


.1763 


Transition-Good 


+.6*133® 


. 3 C 97 

i 


. 176 * 



a. Significant at the level, for 1*1 degrees of freedom. 

b. Significant a f - the T0$ level, for l*i degrees of freedom. 
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1 . 

2 . 

3. 






6 . 



7. 



8 . 



9 . 

10 . 
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